Papers by Iraklis A. Klampanos
Peek2: Regex-free Byte-level Byte-Pair Encoding Pretokenizer for LLM Inference on Edge Devices (2026.acl-srw)
Copied to clipboard
| Challenge: | Pretokenization is a crucial, sequential pass in Byte-level BPE tokenizers . little work has been done to optimize it for edge-side inference . |
| Approach: | They propose a pretokenization algorithm with linear time complexity and trivial memory usage that is suited for edge scenarios. |
| Outcome: | The proposed pretokenization algorithm improves microbenchmarking throughput by 2.48 and delivers 1.14 improvement in overall throughput across the entire Byte-level BPE encoding process. |